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Summary 


This  briefing  is  based  solely  on  the  number  of  appraisals  reported  to  the  SEI.  It  cannot  be  used  as  a  source  for  an  exact  indicator  of 
all  organizations  in  the  world  using  SEI  models  or  appraisal  methods  nor  can  it  be  used  for  certification  or  verification  purposes. 

The  SEI  does  not  certify  organizations.  The  SEI  only  licenses  SEI  partners  and  SEI  authorized  lead  assessors  to  conduct  appraisals. 
Neither  the  SEI  nor  any  other  organization  is  a  “certifying  authority”  of  the  results  from  an  appraisal.  Therefore  requests  to  the  SEI  to 
provide  information  to  be  used  for  this  purpose  can  not  be  fulfilled.  Information  provided  by  the  SEI,  such  as  this  briefing,  is  to 
demonstrate  use  of  its  products  and  services  only. 

Organizations  performing  source  selection  or  verification  should  consider  performing  an  evaluation  appraisal.  For  more  information  on 
appraisal  methods  and  for  a  directory  of  authorized  lead  appraisers  who  can  perform  them,  visit: 
http://www.sei.cmu.edu/managing/app.directory.html 
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Introduction  - 1 :  Purpose  and  Source 

Characterize  the  process  maturity  of  the  software 
community 

This  briefing  uses  information  from  appraisals  using  the 
SW-CMM  in: 

•  CMM®-Based  Appraisals  for  Internal  Process 
Improvement  (CBA  IPIs)  and 

•  Software  Process  Assessments  (SPAs)  and 

•  Standard  CMMI®  Appraisal  Method  for  Process 
Improvement  (SCAMPISM),  vl  .1 

Please  visit: 

http://www.sei.cmu.edu/sema/profile_about.html 

for  additional  information  or  to  answer  questions  you  may 
have  about  this  briefing 
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Introduction  -  2:  Briefing  Contents 

This  briefing  includes  three  primary  sections: 

1.  Current  Status 

-  Snapshot  of  the  software  community  based  on  the  most 
recent  appraisal,  since  2000  >  °f  reporting  organizations 

2.  Community  Trends 

-  Global  distribution  of  appraisals 

-  Growth  in  the  number  of  appraisals  performed 

-  Shifts  in  the  maturity  profile  over  time 

3.  Organizational  Trends 

-  Analysis  of  Key  Process  Area  (KPA)  satisfaction 

-  Time  to  move  up  in  maturity  based  on  change  in  maturity 
level  and  time  between  appraisals 
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Section  1 :  Current  Status 

Appraisals  conducted  from  2000  through  December  2004 
and  reported  to  the  SEI  by  January  2005 

*  1,940  organizations 

*  894  participating  companies 

•  10,038  projects 

•  58.7%  Non-USA  organizations 


Please  refer  to:  Terms  Used  in  this  Report  on  page  29 
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Maturity  Profile 

by  All  Reporting  Organizations 

100%  T 

90%  - 

80%  - 

70%  - 

60%  - 


50% 


Initial  Repeatable  Defined  Managed  Optimizing 


Based  on  most  recent  appraisal,  since  2000,  of  1,940  organizations  reporting  a  maturity  level  rating 
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Reporting  Organization  Categories 


%  of  Organizations 

Based  on  1,940  organizations  reporting  organization  categories 


100% 
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J 


Maturity  Profile 

by  Reporting  Organization  Categories 


100%  -i 


Initial  Repeatable  Defined  Managed  Optimizing 

□  Commercial/ln-house  ■  DoD/Fed  Contractor  □  Military/Federal 

Based  on  most  recent  appraisal,  since  2000,  of  1,940  organizations  reporting  categories  and  a  maturity  level  rating 
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Organization  Type 

Based  on  Primary  Standard  Industrial  Classification  (SIC)  Code 


Based  on  818  organizations  reporting  SIC  code.  For  more  information  visit:  http://www.osha.gov/oshstats/sicser.html 
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Organization  Size 

Based  on  the  total  number  of  employees  within  the  area  of  the  organization  that  was  appraised 


9.9% 


Based  on  1,902  organizations  reporting  size  data 
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Maturity  Profile  by  Organization  Size 

Based  on  the  total  number  of  employees  within  the  area  of  the  organization  that  was  appraised 


100%  i 


90% 

80% 


The  number  of  organizations  for  the  2000+  category  is  small  whic  h 
inflates  the  maturity  level  bars.  Please  see  page  9  and  take  this  into 
account.  The  purpose  of  this  chart  is  to  indicate  that  all  size 
categories  contain  most,  if  not  all,  maturity  levels. 


25  or  fewer  26  to  50  51  to  75  76  to  100 

□  Initial  E  Repeatable 


101  to  200  201  to  300  301  to  500 

□  Defined  □  Managed 


501  to  1000  1001  to  2000 
■  Optimizing 


2000+ 


Based  on  1,902  organizations  reporting  size  data  and  a  maturity  level  rating 
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USA  and  Non-USA 

Reporting  Organization  Categories 


DoD/Fed  Contractor 


Military/Federal 


3.7% 


□  USA 

□  Non-USA 
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%  of  Organizations 

Based  on  802  U.S.  organizations  and  1138  Non-USA  organizations  reporting  organization  categories 
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Maturity  Profile  by  All  Reporting 
USA  and  Non-USA  Organizations 
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Based  on  802  U.S.  organizations  and  1138  Non-USA  organizations  reporting  categories  and  a  maturity  level  rating 


48.6% 


Initial  Repeatable  Defined  Managed  Optimizing 

□  USA  ■  Non-USA 
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Section  2:  Community  Trends 

CBA  IPIs  ,  SPAs  and  SCAMPI  vl.1  using  the  SW-CMM  conducted 

since  1987  through  December  2004  and  reported  to  the  SEI  by 
January  2005 

*  3,590  appraisals 

3,042  CBA  IPIs 
484  SPAs 
64  SCAMPIS 

*  2,746  organizations 

*  1,036  participating  companies 

*  663  reappraised  organizations 

*  15,128  projects 


Please  refer  to:  Terms  Used  in  this  Report  on  page  29 
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Countries  Where  Appraisals  have  been 
Performed  and  Reported  to  the  SEI 


Argentina 

Australia 

Austria 

Barbados 

Chile 

China 

Colombia 

Costa  Rica 

Egypt 

Finland 

France 

Germany 

India 

Indonesia 

Ireland 

Israel 

Latvia 

Lithuania 

Malaysia 

Mauritius 

New  Zealand 

Norway 

Pakistan 

Peru 

Puerto  Rico 

Russia 

Saudi  Arabia 

Singapore 

Switzerland 

Taiwan 

Thailand 

Turkey 

United  States 

Uruguay 

Venezuela 

Vietnam 

Belgium 

Brazil 

Canada 

Cyprus 

Czech  Republic 

Denmark 

Greece 

Hong  Kong 

Hungary 

Italy 

Japan 

Korea,  Republic  of 

Mexico 

Morocco 

Netherlands 

Philippines 

Poland 

Portugal 

South  Africa 

Spain 

Sweden 

Ukraine 

United  Arab  Emirates 

United  Kingdom 
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Number  of  Appraisals  and  Maturity  Levels 
Reported  to  the  SEI  by  Country 


Country 

Number  of 
Appraisals 

Maturity 
Level  1 
Reported 

Maturity 
Level  2 
Reported 

Maturity 
Level  3 
Reported 

Maturity 
Level  4 
Reported 

Maturity 
Level  5 
Reported 

Country 

Number  of 
Appraisals 

Maturity 
Level  1 
Reported 

Maturity 
Level  2 
Reported 

Maturity 
Level  3 
Reported 

Maturity 
Level  4 
Reported 

Maturity 
Level  5 
Reported 

Arqentina 

10  or  fewer 

Malaysia 

1 0  or  fewer 

Australia 

36 

Yes 

Yes 

Yes 

No 

Yes 

Mauritius 

1 0  or  fewer 

Austria 

10  or  fewer 

Mexico 

25 

Yes 

Yes 

Yes 

Yes 

Yes 

Barbados 

10  or  fewer 

Morocco 

1 0  or  fewer 

Belgium 

12 

Yes 

Yes 

Yes 

No 

kb 

Netherlands 

24 

Yes 

Yes 

Yes 

No 

Yes 

Brazil 

28 

Yes 

Yes 

Yes 

Yes 

Yes 

New  Zealand 

1 0  or  fewer 

Canada 

79 

Yes 

Yes 

Yes 

Yes 

Yes 

Norway 

10  or  fewer 

Chile 

19 

Yes 

Yes 

Yes 

No 

Yes 

Pakistan 

10  or  fewer 

China 

243 

Yes 

Yes 

Yes 

Yes 

Yes 

Peru 

10  or  fewer 

Colombia 

10  or  fewer 

Philippines 

11 

No 

Yes 

Yes 

No 

Yes 

Costa  Rica 

10  or  fewer 

Poland 

10  or  fewer 

Cyprus 

10  or  fewer 

Portugal 

10  or  fewer 

Czech  Republic 

10  or  fewer 

Puerto  Rico 

1 0  or  fewer 

Denmark 

10  or  fewer 

Russia 

1 0  or  fewer 

Egypt 

10  or  fewer 

Saudi  Arabia 

1 0  or  fewer 

Finland 

10  or  fewer 

Singapore 

23 

Yes 

Yes 

Yes 

No 

Yes 

France 

142 

Yes 

Yes 

Yes 

Yes 

Yes 

South  Africa 

1 0  or  fewer 

Germany 

62 

Yes 

Yes 

Yes 

No 

kb 

Spain 

26 

No 

Yes 

Yes 

No 

Yes 

Greece 

10  or  fewer 

Sweden 

1 0  or  fewer 

Hong  Kong 

10  or  fewer 

Switzerland 

10  or  fewer 

Hungary 

10  or  fewer 

Taiwan 

1 0  or  fewer 

India 

387 

Yes 

Yes 

Yes 

Yes 

Yes 

Thailand 

15 

Yes 

Yes 

Yes 

No 

kb 

Indonesia 

10  or  fewer 

Turkey 

1 0  or  fewer 

Ireland 

10  or  fewer 

Ukraine 

1 0  or  fewer 

Israel 

30 

Yes 

Yes 

Yes 

No 

kb 

United  Arab 
Emirates 

1 0  or  fewer 

Italy 

33 

Yes 

Yes 

Yes 

No 

Yes 

United  Kingdom 

139 

Yes 

Yes 

Yes 

No 

No 

Japan 

149 

Yes 

Yes 

Yes 

Yes 

Yes 

United  States 

1947 

Yes 

Yes 

Yes 

Yes 

Yes 

Korea,  Republic  of 

75 

Yes 

Yes 

Yes 

Yes 

Yes 

Uruguay 

1 0  or  fewer 

Latvia 

10  or  fewer 

Venezuela 

1 0  or  fewer 

Lithuania 

10  or  fewer 

Vietnam 

1 0  or  fewer 

The  organization  maturity  profile,  page  8,  can  be  created  for  certain  countries  using  the  Interactive  Maturity  Profile  available 
in  the  Software  Engineering  Information  Repository  Web  site.  Please  visit:  http://seir.sei.cmu.edu.  If  you  are  not  already  a 
member  of  the  SEIR  web  site,  please  register  to  join.  Registration  and  use  of  the  site  are  free. 
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Number  of  SW-CMM  Appraisals  Reported  to 
the  SEI  by  Year 


■  First  Appraisal  □  Reappraisal 


Based  on  3,590  appraisals  conducted  through  Dec  2004  and  reported  to  the  SEI  by  Jan  2005 
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Software  Engineering  Institute  Software  CMM  -  CBA  IPI,  SPA  and  SCAMPI  Appraisal  Results 

Number  of  SW-CMM  Appraisals  Reported 
to  the  SEI  by  Organization  Categories  and 
Year 

500  - 

450  -  - 

400  -  - 

8)  350  - -  - 


"re 


1987  1988  1989  1990  1991  1992  1993  1994  1995  1996  1997  1998  1999  2000  2001  2002  2003  2004 
□  Commercial/ln-house  ■  DoD/Fed  Contractor  □  Military/Federal 


Based  on  3,588  appraisals  reporting  organization  categories 
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Trends  in  the  Community  Maturity  Profile 


100%  i 


90%  - 


80% 

70% 

60% 

50% 

40% 

30% 

20% 

10% 

0% 


Year 

Orgs 

□  1987-1991 

132 

■  1992-1996 

635 

□  1997-2001 

1,660 

□  2002 

1,996 

■  2003 

2,419 

□  2004 

2,746 

Initial  Repeatable  Defined  Managed  Optimizing 


Based  on  a  cumulative  view  of  the  most  recent  appraisals  of  organizations  up  through  the  year  indicated. 
This  accounts  for  the  difference  from  the  figures  on  page  5. 
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Section  3:  Organizational  Trends 

Appraisals  conducted  through  December  2004  and  reported  to 
the  SEI  by  January  2005 

•  1 ,839  Key  Process  Area  (KPA)  profiles 

-  satisfaction  of  KPAs  by  maturity  level  for  organizations 
appraised  at  levels  1  and  2 

•  663  reappraised  organizations 

-  accounting  for  1,517  appraisals 

-  although  some  organizations  conducted  multiple 
reappraisals,  only  the  first  and  latest  appraisals  were  used 
in  creating  the  charts  on  pages  23  &  24 


Please  refer  to:  Terms  Used  in  this  Report  on  page  29 
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Key  Process  Area  Profiles  - 1 
Organizations  Appraised  at  Level  1 


Based  on  576  CBA  IPI  and  SCAMPI  with  SW-CMM  appraisals  reporting  a  maturity  level  rating 
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Key  Process  Area  Profiles  -  2 
Organizations  Appraised  at  Level  2 


40%  50%  60% 

%  of  Appraisals 


100% 


Based  on  1263  CBA  IPI  and  SCAMPI  With  SW-CMM  appraisals  reporting  a  maturity  level  rating 
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Maturity  Level  of 

First  and  Latest  Appraisal 

100%  T 

90%  - 


80% 


70% 

</> 

c 

o 

~  60% 

CO 

N 


§  50% 

U) 


Initial  Repeatable  Defined  Managed 

□  First  ■  Latest 

Based  on  663  reappraised  organizations  using  their  first  and  latest  appraisal 


Optimizing 
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Reappraisals 
Change  in  Maturity  Level 

Level  4  to  5 


No  Change 

12.7% 

Level  1  to  1 

5.3% 

Level  2  to  2 

4.7% 

Level  3  to  3 

1.7% 

Level  4  to  4 

0.5% 

Level  5  to  5 

0.6% 

0.8% 


Based  on  663  reappraised  organizations  using  their  first  and  latest  appraisal 
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Time  to  Move  Up 


Orgs  25  12  170  255  60  62  195  267  62  62 
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Summary  of  Current  Status 


Commercial  and  in-house  organizations  reporting  most 
appraisals 

Of  U.S.  organizations,  the  services  and  manufacturing 
industries  reported  most  appraisals 

Half  of  the  organizations  reporting  size  have  100  or  fewer 
software  personnel 

More  Non-USA  appraisals  reported  than  U.S.  in  this  5  year 
snapshot 
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Summary  of  Organizational  Trends  - 1 


The  total  number  appraisals  for  2004  is  less  than  2003.  It  is  the 
first  time  decrease  since  1996 


Software  Subcontract  Management  is  the  least  frequently 
satisfied  level  2  KPA  among  organizations*  appraised  at  level  1 

Integrated  Software  Management  is  the  least  frequently  satisfied 
level  3  KPA  among  organizations*  appraised  at  level  2 

Higher  maturity  has  been  reached  among  those  organizations 
reporting  reappraisals 
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Summary  of  Organizational  Trends 

(continued)  -  2 

For  organizations  that  began  their  CMM-based  SPI  effort  in 
1992  or  later,  the  median  time  to  move  from: 

•  maturity  level  1  to  2  is  20  months 

•  maturity  level  2  to  3  is  19  months 

•  maturity  level  3  to  4  is  25  months 

•  maturity  level  4  to  5  is  13  months 


Note:  The  median  time  to  move  from  maturity  level  1  to  2  dropped  from  22  month  to  20  month 
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Terms  Used  in  this  Report 

Appraisal  -  The  appraisal  methods  used  in  this  report  are  the  Software  Process 

Assessment  (SPA),  CMM-Based  Appraisal  for  both  Internal 
Process  Improvement  (CBA  IPI)  and  Standard  CMMI®  Appraisal 
Method  for  Process  Improvement  (SCAMPI).  We  do  request  and 
receive  other  Software  CMM-based  appraisals  such  as  Software 
Capability  Evaluations  (SCE)  and  Interim  Profiles.  As  our  sampling 
size  of  these  other  methods  increase,  they  will  be  reported  here. 

Company  -  Parent  of  the  appraised  entity 

A  company  can  be  a  commercial  or  non-commercial  firm,  for-profit 
or  not  for-profit  business,  a  research  and  development  unit,  a  higher 
education  unit,  a  government  agency,  or  branch  of  service,  etc. 

Organization  -  a.k.a.  Appraised  entity 

The  organization  unit  to  which  the  appraisal  results  apply.  An 
appraised  entity  can  be  the  entire  company,  a  selected  business 
unit,  units  supporting  a  particular  product  line  or  service,  etc. 

Non-USA  -  Appraised  entity  whose  geographic  location  is  not  within  the  United 

States.  The  parent  of  the  appraised  entity  may  or  may  not  be  based 
within  the  United  States. 
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Report  your  Appraisal  Results  to  the  SEI 

The  briefing  is  only  possible  due  to  the  cooperation  of 
organizations  and  individuals  sending  in  their  appraisal 
results  to  the  SEI 

In  order  to  provide  this  information  and  service  in  the  future, 
it  will  depend  on  this  continued  cooperation 

Please  visit: 

http://www.sei.cmu.edu/sema/report.html 

for  forms,  information,  and  instructions  on  how  to  report 
appraisals  to  the  SEI 
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Contact  Information 

Please  visit: 

http://www.sei.cmu.edu/sema/profile_about.html 

and  review  the  information  provided  before  contacting: 

SEI  Customer  Relations  (41 2)  268-5800 

SEI  FAX  number  (41 2)  268-5758 

Internet  Address 
customer-relations@sei.cmu.edu 

Mailing  Address 
Customer  Relations 
Software  Engineering  Institute 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213-3890 
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